IMAGE PROCESSING METHOD AND SYSTEM, AND STORAGE MEDIUM 



BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image processing method 
and system in which representation of the difference between two* 
or more images taken of the same subject is improved. 

Description of the Related Art 

It is a common practice in a wide variety of fields to read 
and compare a plurality of two or more images taken of the same 
subject in order to discern the difference between images, and 
carry out an inspection of the subject based on the thus discerned 
difference, etc. 

In the industrial products manufacturing industry, for 
example, images taken of a product when it is new and images taken 
of the same product after it has been subjected to an endurance 
test are compared, and attention is focused on the area showing 
the biggest difference so that an examination as to whether or 
not there are areas requiring improvement in product endurance 
can be carried out . In the medical field, doctors read and compare 
a plurality of radiation images of the diseased part of a patient 
taken in a time series manner in order to ascertain the course 
of the disease and determine the proper treatment. 

In this fashion, reading and comparison of a plurality of 
images is carried out daily in a wide variety of fields, with 
the images to be read and compared being output to a display means 
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such as a monitor, to film, or another recording medium. In other 
words, the image is converted to luminescence and density signals 
and displayed on a monitor, etc., or output to film or another 
hard-copy recording medium by a printer or the like. 
5 Generally, although the area of the most interest to the 

viewer of such images is the area wherein the greatest difference 
is shown, when the images to be read and compared are output, 
they are simply lined up and output . However, under such condi tions , 
the smaller the difference between the images is, the more 

10 difficult it becomes to discern. 

Therefore, image processing methods that facilitate 
discernment of the difference between images with a higher degree 
of accuracy and reliability are desired. These generally start 
with a subtraction process that calculates the difference between 

15 corresponding structural positions (anatomically characteristic 
positions) of the two images, followed by extraction and 
enhancement of the aforementioned difference (Japanese Patent 
ApplicationNo . 11(1999) -342900) . Inthisway, only the difference 
between images is extracted and enhanced, thereby enabling the 

20 viewer to ascertain the difference with certainty, and this is 
considered to contribute greatly to the prevention of misdiagnosis 
due to oversight of a diseased part requiring treatment or the 
course of progression of a disease. 

In addition, when computation of the inter image - difference 

25 is to be performed, it is necessary to firs t align the corresponding 
positions of structural bodies appearing in each image (structural 
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positions) . Such alignment might entail as a first alignment, 
for instance, a global transformation (affine transformation, 
etc.) of parallel displacement , rotating and enlarging or reducing 
the images, and the image obtained thereby is then subjected to 
5 a second alignment entailing the division of the aligned image 
into a plurality of local - regions, and then matching each 
corresponding local-region, based upon which a non-linear 
distortion translation (warping) dependent on curve - fitting 
(two-dimensional, 10 th order polynomial function) is performed. 

10 The utilization and combination of such techniques , etc . are known 
as shown in Japanese Unexamined Patent Publication No. 
7 (1995) -37074, etc . 

However, after aforementioned alignment has been performed, 
small misregistrations occur between the outlines of structural 

15 positions that have not been perfectly aligned 

(position-misregistration) , and artifacts appear in an 
inter image - difference image where posit ion -misregistrations 
occur at such outlines. Up until now, if no artifacts appeared 
in an interimage - difference image, because only the substantial 

20 difference between two images, representing the change due to 
the progress of the course of a disease, etc. of a diseased part, 
showed up, the size of a diseased part, the course of a disease, 
etc. could be effectively judged. If artifacts appeared in the 
imagehowever , they obscured and thereby prevented the substantial 

25 difference from being discerned with accuracy, creating the 
possibility that the difference might be overlooked. 
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Particularly for cases in which the images are radiation 
images, because the three-dimensional (3-D) misalignments, 
occurring due to the slight changes in the direction from which 
the radiation is emitted, the axis of the body and its angle, 
the angle at which the radiation enters the subject, etc., 
represented in a two-dimensional (2-D) image are exceedingly 
difficult to correct by use of alignment techniques, the 
appearance of artifacts is to some extent unavoidable. 

However, it is necessary to eliminate the potential that 
the substantial difference be overlooked due to the appearance 
of artifacts. 

SUMMARY OF THE INVENTION 

The present invention has been developed in consideration 
of the in the prior art problems described above. 

Accordingly, the first objective of the present invention 
is to provide an image processing method and system that reduces, 
more than in the prior art, the occurrence of artifacts, relative 
to the substantial difference between two images, due to 
misalignment of structural positions within the images. 

The image processing method and system of the present 
invention improve examination - reading efficiency of the 
substantial difference between two images, which is the area of 
interest to a viewer of the images, by enhancement of said 
substantial difference relative to said artifacts, and thereby 
further reducing the occurrence of artifacts due to misalignment 
of structural positions, which adversely affect 



inspection- reading of the difference between images. 

That is to say, the image processing method of the present 
invention, in which two desired images from among a plurality 
of images taken of the same subject are subjected to an 
5 interimage-dif f erence computation process to obtain an 

interimage-dif f erence image representing the difference between 
the two images, is characterized in that the substantial 
difference between the aforementioned two images represented in 
the interimage-dif f erence image is enhanced relative to the 

n 

10 artifacts appearing in the interimage-dif f erence image due to 
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misalignment of corresponding structural positions of 
aforementioned two images. 



M 

m As aforementioned two images, the present invention is 

O applicable to radiation images taken of the same subject at 

UJ 

Q 15 different points in time in a time sequence manner. Application 

CO 

O of the present invention is particularly effective for images 

CI 

taken of a live body. Because the internal structures of a living 
body move in three dimensions, the relationship of corresponding 
structural positions between the two images easily become 

20 displaced between images, due to the ease with which 
position -misregistrations (misalignments) occur . 

Note that the referent of the expression " two desired images 
from among two or more images taken of the same subject" is not 
limited to images taken of the same part of the same subject at 

25 different points in time in a time series manner, but also can 
include each portion representing each portion of images taken 
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on the same day containing positions of substantially the same 
form (for example, left and right lungs, left and right breasts, 
etc) . That is to say, the referent of "two images", or "two or 
more images" is not limited to being two different images, but 
can refer also to different sections of the same image. 

Employment of a subtraction process between the 
corresponding structural positions of two images is advantageous 
in the present invention, because it is easy to improve the clarity 
of the difference between the two images obtained thereof by 
expressing the difference as an image signal. Note that, the 
present invention is not limited however, to being able to employ 
only a subtraction process as image processing; the application 
of processes such as a division process , etc. cannot be discarded . 
The subtraction process can comprise simple subtraction, or a 
weighted subtraction . The image obtained by a subtraction process 
is generally called a subtraction image. Subtraction images 
include energy subtraction images, which are obtained by 
performing simple subtraction between two original energy images 
differing in energy distribution profiles (original images: a 
high energy image <a normal radiation image), a low-energy image 
<a high - energy control image > ) obtained at substantially the same 
in a time in a time sequence manner ; time-elapse subtraction images, 
which are obtained based on two original images taken at different 
points in time in a time series manner; DSAs (Digital Subtraction 
Angiographs) , which are obtained based on two original images 
of a vein taken before and after a contrast medium has been inj ected 



into a vein, etc. 

Relative - enhancement processing of the artifacts 
appearing in the substantial difference between two images 
represented in the interimage - difference image can entail 
enhancement of the artifacts, or conversely, the control of such 
artifacts . 

Application of a processing method based on a morphology 
process, which utilizes structural elements smaller than the 
substantial difference and larger than the artifacts, to control 
artifacts relative to the substantial difference is advantageous . 
This is because is such artifacts can be effectively controlled 
without adversely effecting the image clarity of the substantial 
dif f erence be tween two images. Generally, morphology is developed 
as a set theory for an N- dimensional space, however, there are 
many examples of its application to two-dimensional images (refer 
to Japanese Unexamined Patent Publication Nos . 8 (1996) -272961, 
9 (1997) -248291, 9 ( 1 9 97 ) - 9 14 2 1 ) . Hereinafter follows a simple 
explanation of the morphology process, using a contrast - image 
as an example. 

A one- dimensional function f (x) is tobe applied to a section 
of a contrast image regarded as a space having an adequate height 
at a point with the coordinates (x, y) having a contrast value 
f. As shown in formula (1), the morphology process utilizes 
structural element g in a symmetrical function symmetrical to 
the original point. 



[Formula 1] 

S s (X) =g (-X) (1 ) 

The value for the defined area is 0, and the defined area 
g is as shown in equation (2) . 
[Formula 2] 

G ={-m,-m+1, — ,-1 ,0,1 , — ,m-1,m} ( 2 ) 

At this juncture, the base shape of the 
morphology- computation is extraordinarily simple, as shown in 
formulae (3) - (6) 

[Formula 3] 

dilation ; [f 0G S ] ( i )=max{f (i-m) , — , f (i ) , , f (i +m)} ( 3 ) 
erosion ; [f 0G S ] ( i )=mi n{f (i -m) , — f f (i ) , — , f (i+m)} (4) 
opening ; f g =(f0g s )©g ( 5) 

closing ;f e =(f0g s )0g (6) 

That is to say, the dilation process comprises finding the 
largest value within the range of the width! m (the value determined 
in accordance to structural element B, corresponding to the mask 
size shown in Figs. 9A to 9D) , for the pixels of interest at 
the center thereof (refer to Fig. 9A) . On the other hand, the 
erosion process comprises finding the smallest value within the 
range of the width +m for the pixels of interest at the center 
thereof (refer to 9B) . Additionally, the opening - process 
comprises performance of the erosion process followed by 
performance of the dilation process, in other words, the process 
of first finding the smallest value, and then finding the largest 
value; and the closing - proces s comprises performance of the 
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dilation process followed by performance of the erosion process, 
in other words, the process of first finding the largest value, 
and then finding the smallest value. 

In other words, the opening-process corresponds to 
5 smoothing density curve f (x) from the low- density side so as 
to control the convex - shaped contrast - shift areas (portion having 
a higher density than that of the areas surrounding it) to a 
spatial range narrower than that of mask 2m (refer to Fig. 9C) . 
On the other hand, the closing -process corresponds to 
10 smoothing density curve f (x) from the high-density side so as 
to contain the concave - shaped contrast - shift areas (portion 
having a lower density than that of the areas surrounding it) 
to a spatial range narrower than that of mask 2m (refer to Fig. 
O 9D> . 

UJ 

O 15 Here, compared to cases in which there is a signal having 

CO 

p a high luminescence signal level, the relationship is reversed 
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for cases in which there is a signal having a high density signal 
level in correlation to the increase in density level thereof: 
the dilation processing of a signal having a high density signal 

20 level is equivalent to the erosion processing of a signal having 
a high luminescence signal level (refer to Fig. 9B) ; the erosion 
processing of a signal having a high density signal level is 
equivalent to the dilation processing of a signal having a high 
luminescence signal level (refer to Fig. 9A) ; the 

25 opening -processing of a signal having a high density signal level 
is equivalent to the closing-processing of a signal having a high 
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luminescence signal level (refer to Fig. 9D) ; and the 
closing -processing of a signal having a high density signal level 
is equivalent to the opening -processing of a signal having a high 
luminescence signal level (refer to Fig. 9B) . 

Therefore, by subjecting an image signal representing an 
original image to opening or closing morphology ( "Morphology", 
authored by Kobatake, published by Corona, etc.), granularity 
(meaning the noise in an image) can be controlled (or eliminated) . 
Note that although for the sake of simplicity an explanation has 
been proffered using a one - dimensional mask (structural element) 
for a one-dimensional density distribution as an example, for 
cases in which an image expands two - dimensionally , multiple 
one - dimensional structural elements can be set therein, and 
multiple iterations of the processing can be performed, once for 
each structural element, or a two dimensional - structural element 
can be set and processing can be concluded after one iteration 
of the processing on the two-dimensional structural element. 

The apparatus according to the present invention for 
performing the image processing method of the present invention 
is provided with an image processing means for processing an 
interimage - difference image obtained by subjecting two desired 
images from among two or more images obtained of the same subject 
to interimage-processing; wherein, aforementioned image 
processing means subjects aforementioned interimage - difference 
image to processing so as to emphasize the substantial difference 
between the two images relative to the artifacts occurring due 



to misalignment of structural elements with the two images. 

Note that as described above, aforementioned "two desired 
images from among two or more images taken of the same subject" 
can refer, for example, to two radiation images taken of the same 
part of the same subject at different points in time in a time 
series manner, but is not limited to this. 

Application of the present invention to two or more X-ray 
images of the same subject take at different points in time for 
the purpose of comparison is effective and advantageous. 

It is preferable that subtraction processing be applied 
between corresponding structural positions of two images as the 
inter image processing . 

As an image processing means, it can be used to carry out 
image processing so as to control the artifacts relative to the 
substantial difference between two images, or conversely, to 
emphasize the substantial difference between to images relative 
to the artifacts occurring thereof. For cases in which the image 
processing means performs processing to control the artifacts, 
it is desirable that such processing be performed based on the 
application of morphology employing structural elements that are 
larger than the artifacts and smaller than the substantial 
difference . 

Note that there is nothing in the image processing method 
and apparatus described above that interferes application thereof 
to subject matter other than the human body, such as plants and 
animals, industrial products, geological formations, heavenly 



bodies, landscapes, etc. 

According to the image processing method and apparatus of 
the present invention, by subjecting an interimage-dif f erence 
image to processing so as to enhance the substantial difference 
between to images relative to the artifacts, which adversely 
effect image examinability , the artifacts can be reduced relative 
to the substantial difference between the images, which is the 
portion of interest between the images, and the difference between 
the images is thereby rendered more easy to examine than in the 
prior art, and image examining efficiency is improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 shows the configuration medical network 
implementing an embodiment of the image processing apparatus of 
the present invention, 

Figure 2A and 2B show two original images that are to be 
subjected to temporal subtraction processing by the interimage 
processing apparatus , 

Figure 3 is a figure provided for explanation of global 
matching, 

Figure 4 is a figure provided for explanation of local 
matching , 

Figure 5 is a figure provided for explanation of non- linear 
warping transformation , 

Figure 6A, 6B and 6C show a case in which the first image, 
and the second image, have been completely matched, and a 
subtraction image, 
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Figure 7 shows an example of an substantial subtraction 

image , 

Figure 8A to 8D are figures provided for explanation of 
the temporal image processing performed in the current embodiment, 



Figure 9A to 9D are figures provided for explanation of 
morphology . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Hereinafter, a preferred embodiment of the image processing 

10 method and apparatus according to the present invention will be 
explained with reference to the drawings. 

Figure 1 shows a medical network 100 implementing an 
embodiment of the image processing method and apparatus 10 
according to the present invention. 

15 Connected to network 100 shown in the drawing are: a CR 

(Computed Radiography) 50 or other such medical image formation 
apparatus such as a CT (Computed Tomography) apparatus, MRI 
(Magnetic Resonance) apparatus, etc. ; a cumulative data base 70 
for storing each type of diagnostic image created by 

20 aforementioned medical image formation apparatuses; a display 
apparatus 20 for displaying images stored in database 7 0 and images 
transmitted directly from the image formation apparatuses; an 
interimage processing apparatus 30 that obtains a temporal 
subtraction image (one type of interimage processing image) , based 

25 on two or more image data input thereto, by performing a temporal 
subtraction process, which is one example of interimage 
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and 
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processing; and an image processing apparatus 10 for subjecting 
the subtraction image formed by interimage processing apparatus 
30 to the image processing described below. Note that also 
connected to network 100 are various types of image output devices 
such as printers, etc. for outputting images circulated within 
the network to film, etc. that are not shown in the drawings. 

An image of a subject through which radiation is obtained 
by CR apparatus 50, which is provided with a sheet that has a 
stimulable phosphor layer that absorbs some of the radiation 
energy passed through the subject and records an image thereof 
thereon. Afterwards, by photoelectrically reading the radiation 
energy stored on the stimulable phosphor sheet, which is emitted 
as a stimulated emission when said stimulable phosphor sheet is 
irradiated with a laser beam, the CR apparatus 50 obtains the 
radiation image of the subject as digital image data; such systems 
are in wide use in medical facilities. 

QA-WS workstation 60 (for checking image quality) , which 
is connected along the network between CR apparatus 50 and network 
100, checks images formed by aforementioned CR apparatus 50 and 
other medical image formation apparatuses, and is provided with 
a function for issuing a request to the medical image forming 
apparatus (CR apparatus 50, etc>), to re-take an image, etc. In 
this embodiment, before storing digital image P created by CR 
apparatus 5 0 into database 7 0 , QA-WS 6 0 is provided so as to perform 
an image quality check of the image density, contrast, etc. and 
also a check of the photographed range of the image, etc. 
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Display apparatus 2 0 is not merely for displaying as a visual 
image the images input thereto from database 70, itisalso equipped 
with functions to provide for use thereof as a terminal for 
inputting requests to perform subtraction processing, etc. 
5 between two or more images P taken of the same part of the same 
sub j ect . 

As described above, interimage processing apparatus 30 
obtains a temporal subtraction image, based on two or more chest 
radiation images PI and P2 taken of the same subject at different 

10 points in time in a time series manner and input from database 
70 via network 100, that represents the substantial difference 
between the two images, and also aligns the structural positions 
appearing within images PI and P2 (ribs, the chest, lungs, the 
heart and other organs, etc.): first, a global matching is 

15 performed; after that, a second matching process in which the 
images are divided up into a plurality of local regions, each 
of which is then registered with its respective counterpart; and 
based on the two images obtained thereby, corresponding pixels 
between the two images are subtracted. Note that each matching 

20 process will be explained in detail below. 

The image processing performed by image processing 
apparatus 10 on the temporal subtraction image Psu obtained by 
interimage image processing apparatus 30 comprises the 
enhancement of the substantial difference between images PI and 

25 P2 represented by subtraction image Psu, which has been obtained 
by application of image position matching processes, relative 
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to artifacts L appearing therein due to misalignment between 
structural positions within images PI and P2 . That is to say, 
relative control of artifacts L is not performed wherever they 
are caused by position gaps between structural positions within 
images PI and P2 , but with respect to the tumor or diseased portion 
(hereinafter referred to simply as the diseased portion) appearing 
in only one of either image PI or P2, or to the diseased portion 
K contained in both images PI and P2, etc. , which have different 
densities or outlines in images PI and P2 , being examined to 
determine the effect of treatment and the change over time in 
the course of the disease. 

More specifically, with respect the frequent cases inwhich 
artifacts L, characterized in that they are long and thin forms, 
appear along the outlines of structural bodies, although there 
is change in the diseased portion K that is the substantial 
difference between images according to the course of the disease 
after the initial appearance thereof, the form thereof expands 
in a substantially circular or substantially rectangular form 
of a wider region than the long and narrow form of artifacts L, 
and can be recognized. Accordingly, by application to such a 
subtraction image Psu of morphology processing utilizing 
structural elements larger than the width (at a substantially 
perpendicular cross - sec tion with respect to the lengthwise 
direction thereof) of the long and thin artifacts L and smaller 
than diseasedportion K (for example, circular structural elements 
having such a diameter, rectangular structural elements having 



a side of such a length, etc . ) as said image processing, diseased 
part K, which is larger in size than the structural elements, 
remains and long and thin artifacts L, which are smaller in size 
than the structural elements, can be eliminated. 
5 Note that for cases in which morphology processing is 

applied to subtraction image Psu, which is a high and low density 
image, Psu is divided into a high-density image (the whole image 
obtained by replacing the portion having a density lower than 
the base density with the base density) Psul composed of the base 

f:f 10 density (the portion in which the difference in density between 

iP 

fn! PI and P2 is 0) of Psu and the densities higher than the basic 

jr * 
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density, and a low density image (the whole image obtained by 
replacing the portion having a density higher than the base density 
with the base density) Psu2 composed of the base density and the 



pi 15 densities lower than the base density. High-density image Psul 

til 

pi and low- density image Psu2 are then subjected to aforementioned 

morphology processing, and because it is preferable that the two 
images obtained thereby be subjected to an addition processing 
(at a weighted ratioof 0.5X0.5) , the processing will be explained 
20 as such. 

Next, the operation of the image processing apparatus will 
be explained. 

Chest radiation transparency images PI, P2, Pn are taken 
of a specific patient at different points in time in advance by 
25 CR apparatus 50, and after an image quality control check is 
conducted by QA-WS60 on PI, P2 , ... , Pn, they are stored in database 
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First, an explanation of an example case in which, a request 
that a subtraction image Psu be obtained based on the image taken 
at the most remote point in time (the first image, ) , PI, and an 
image taken at a point in time less remote (the second image, ) , 
P2 has been specified from display terminal 20, which serves as 
the specification input terminal. 

The request input at display terminal 2 0 is input to database 
70 via network 100, and the first image, PI and the second image, 
P2 are input via network 100 to interimage processing apparatus 
30 . 

Interimage processing apparatus 30 first subjects images 
PI and P2 to global matching, in which the structural positions 
between said two images are matched, and then divides each image 
obtained thereby into a plurality of local regions and matches 
the positions of each local region to its respective counterpart . 
That is to say, of the two images shown in Fig. 2 taken in a time 
series manner, the newer image (the second image,) thereof is 
taken as the base image, and the first image, PI, is subjected 
to af fine transformation and globally matched to the second image , , 
P2 (refer toFig. 3) . Continuing, the second image , , P2, of globally 
matched images PI and P2 is subjected to processing wherein it 
is divided into a plurality of hypothetical small rectangular 
template regions T2 by use of a template, the the first image, , 
PI is registered to each template T2 region of the second image, 
P2 . A search region Rl, which is larger than template region T2 , 
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is set for each template region T2, and in each search region 
Rl, the corresponding template region substantially matched to 
each template region T2 of the second image, P2, is obtained (refer 
to Fig. 4) . Based on the shift amount between positions of each 
template region T2 of the second image, P2 , and each corresponding 
template region of the first image, PI, global matching is 
performed so that each corresponding region of the first image, , 
PI is substantially matched to each template region T2 of the 
second image, , P2, and then the first image, , PI, in its entirety 
s subjected to non-linear warping (refer to Fig. 5) and images 
PI and P2 are again matched. 

Further, interimage processing apparatus 30 coordinates 
the pixels of the first image, , PI, which has been subjected to 
the two position matching transformation steps described above, 
and the second image,, P2, which has served as the base image, 
and subjects the first image,, PI, and the second image,, P2, 
to subtraction processing in accordance with formula 7 described 
below, whereby subtraction image Psu of images PI and P2 is 
obtained . 

(Formula 7) 
Psu = (PI - P2) X cont + mid 

Cont : contrast coefficient 

mid : mean value (for cases in which processing is 

10 bit, 512) 

Normally, because the portions of images PI and P2 in which 
there is no difference in density are displayed as the mean value, 
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subtraction image Ssu is formed based on formula 7 . In addition, 
because diseased part K contained in the second image, P2 is 
displayed as a high- density (dark) portion, P2 is subtracted from 
PI. That is to say, due to the frequency of occurrence of cases 
in which diseased part K appears as a low-density shadow in the 
second image, P2, although diseased part K is appears as a low 
density portion in subtraction image P su ' obtained by subtracting 
PI from P2 , because diseased part K is normally displayed as a 
high-density portion on the display apparatus, subtraction image 
Psu is usually converted and then output. Because said conversion 
processing in the display apparatus is omitted in the current 
embodiment, subtraction is carried out based on aforementioned 
formula 7 . 

Note that there are cases for which the order in which images 
PI and P2 are subtracted is reversed. For example, depending on 
the type of disease and the nature of the change thereof, there 
are instances in which diseased part K appears as a high-density 
shadow in the second image, P2 . Further, even for cases in which 
the diseased portion appears as a high-density shadow, because 
of a reversal in the diseased part due to treatment thereof, there 
are cases in which the absence of the diseased part is observed. 
Therefore, the order in which subtraction between images PI and 
P2 is performed can be set according to the type of disease and 
the objective of the examination. 

Here, when the positionmatching described above is complete, 
as shown in Fig. 6, subtraction image Psu, which is the difference 
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between the first image, PI, and the second image, , P2 , represents 
the diseased portion K that is the substantial difference between 
images PI and P2 that is actually only present in the second image, , 
P2, and is not present in the firs t image , , PI. However, inactuality, 
complete matching is very difficult to obtain, and not only 
diseased portion K, but artifacts L (refer to Fig. 7) caused by 
misalignment of the outlines of ribs and other structural bodies 
within the images also remain in subtraction image Psu, and 
examination reading performance suffers thereby. 



0 10 Here, in the current embodiment , image processing apparatus 

Co 

O 10 controls artifacts L remaining in subtraction image Psu 

ill 

%J relative to diseased portion K. More specifically, subtraction 

Ul image Psu (Fig. 8A) is divided into a high-density image (the 

a 

O whole image obtained by replacing the portion having a density 

h? 

O 15 lower than the base density with the base density) Psul composed 

m 

O of the base density (the portion in which the difference in density 

between PI and P2 is 0) of Psu and the densities higher than the 
basic density, and a low density image (the whole image obtained 
by replacing the portion having a density higher than the base 

20 density with the base density) Psu2 composed of the base density 
and the densities lower than the base density (Fig. 8B) . Continuing, 
on the one hand, high- density image Psul is sub j ected to morphology 
processing (opening processing) utilizing structural components 
(round) whose size has been set in advance (Fig. 8C) , and on the 

25 other hand, low-density image Psu2 is subjected to morphology 
processing (closing processing) utilizing structural components 
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(round) whose size has been set in advance (same Fig.) . Here, 
as described above, the structural elements utilized are of a 
size larger than the long and thin artifacts L and smaller than 
diseased portion K, and are set in advance based on the accumulated 
clinical data. For a case in which the size of subtraction image 
Psu is 1760 X 1760 pixels (5 lines/mm) , it is preferable that the 
round structural elements, for example, be of a diameter of 5-10 
pixels. Of course, the structural elements can be changed in 
accordance with the size and shape of the diseased portion in 
the extracted image or the size and shape of the artifacts to 
be eliminated therefrom. 

In the opening process morphology, because high density 
portions within the size range smaller than the structural 
elements are eliminated, almost all artifacts LI (artifacts L 
that appear in the high-density range are designated as artifacts 
LI) larger than diseased portion K are eliminated. Likewise, in 
the closing process morphology, because low-density portions 
within the size range smaller than the structural elements are 
eliminated, almost all artifacts L2 (artifacts L that appear in 
the low-density range are designated as artifacts L2) larger than 
diseased portion K are eliminated (Fig. 8C) . 

The pixels of subtraction images Psul and Psu2 obtained 
in this way are again registered and the addition processing 
performed at a weighted ratio of 0.50 X 0.50 for both images, 
and subtraction image Psu is again recomposed. 

Because subtraction image Psu recomposed and obtained in 



this way is an image in which artifacts L caused by misalignment 
of structural positions in images PI and P2 have been controlled 
relative to diseased portion K of both images PI and P2 (eliminated) , 
obstruction of examination of diseased portion K due to artifacts 
has been reduced, with respect to the prior art. 

Subtraction image Psu, which provides for excellent 
examination performance, is input to image display apparatus 20, 
and displayed as a visible image thereon. Because the artifacts 
contained in the visible image of subtraction image Psu displayed 
on image display apparatus 20 have been controlled, there are 
no obstructions to the examination of diseased portion K, and 
examination efficiency thereof is improved, with respect to the 
prior art. 

According to the image processing apparatus of the current 
embodiment described above, by performing image processing, on 
an interimage -processed image, that enhances the substantial 
difference of the two images relative to the artifacts, artifacts, 
which can have an adverse effect on the image examination, can 
be reduced relative to the substantial difference between two 
images, which is the portion of interest to an examiner of the 
image, and examination of the substantial difference between two 
images can be performed more efficiently and effectively relative 
to the prior art. 

In the current embodiment, an opening process morphology 
processing was performed on high-density subtraction image Psul, 
however, the same results obtained by application of the opening 



process morphology can be obtained by application of a minimum 
filter in place thereof. Likewise, a closing process morphology 
processing was performed on low-density subtraction image Psu2, 
however, the same results obtained by application of the closing 
5 process morphology can be obtained by application of a maximum 
filter in place thereof. 

In addition, because there are narrow ranges in which the 
density in a high and low contrast image changes drastically, 
artifacts having such sheer are searched by a Laplacian filter, 
y. 10 and by subjecting to a smoothing processing the artifact obtained 

!!; by the search therefor, the artifacts can be controlled relative 

ill 

to the substantial difference of the diseased portion, etc. 

"a 

Likewise, because artifacts contain many more frequency 
components in the high frequency range than does the substantial 



15 difference of the diseased portion, etc., the detected high 



frequency components can be made to be un- sharp. Making the high 
frequency components un- sharp can comprise performance of a 
Fourier transformation and excluding the high frequency range, 
and then performing a reverse Fourier transformation, or an 

20 processing utilizing an un- sharpness mask can be employed to 
smooth out the edges. Note that for the radiation image that was 
the subj ect of the image processing applied by the image processing 
apparatus of the embodiment described above, the artifacts 
occurred mainly due to the ribs, which extended in the horizontal 

25 direction, and a even if un- sharpness processing is performed 
only in the vertical direction, the effect of the present invention 
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can be adequately obtained. 

In addition, instead of processing that controls the 
artifacts, processing that emphasizes the substantial difference 
of the diseased portion, etc. can be performed. For example, the 
5 low frequency components that represent the tumor, etc. that is 
the diseased portion can be emphasized. Of course, it is also 
possible to perform processing to control the artifacts as well 
as processing to emphasize the substantial difference of the 
diseased portion, etc. 

yes. 

P 10 Note that in the embodiment described above , by performance 

iii 

|4 by interimage processing apparatus 30 of the non-linear 

Q 

Cj transformation (warping) to match the positions of the local 

■k. 5 

hf regions , the first image, , PI , as shown in Fig . 5 , does not maintain 

p its original image shape (rectangular) . Accordingly, the first 

hi 

p 15 image, PI, after being subjected to warping does not does not 

00 

p have the exact rectangular outline as shown in Fig. 6A, but has 

M 

a curved, non - linear outline . On the other hand , because the second 
image, P2 has been subjected to no transformation processing 
whatsoever, it has a straight - line outline . Therefore, whenpixels 

20 of the two images are to be registered and subtraction processing 
performed, there are cases for which there is no corresponding 
pixel in the first image, , PI that has been subjected to warping 
for a pixel in the second image, P2, and subtraction processing 
cannot be performed for the missing pixel. 

25 In such a case, when there is no corresponding pixel in 

the image subjected to transformation processing (image PI in 
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the embodiment described above) for a pixel in the image not 
subjected to transformation processing, which serves as the base 
image, a new pixel can be set for the missing pixel, and the pixel 
value of that pixel can be given the same value as the corresponding 
pixel in the corresponding image (the second image,). 

In addition, aside from supplementing the pixels in this 
way, the pixel in the base image can be deleted, the same as the 
pixel in the image that has been subjected to transformation 
processing. Because there are extremely few instances in which 
the portion of the image having no corresponding pixel f alls wi thin 
the region of the containing the area of interest to an examiner 
of the image, it has conventionally thought to be unnecessary. 
Carrying this idea one step further, by performance of an 
extraction processing that extracts only the image portions of 
the regions of interest contained within each of the images , which 
are the image subjected to warping (the first image,) and the 
base image (the second image, ) , the portion of the images to be 
subjected to subtraction processing can be limited in advance. 
This is also desirable in that the amount of computation is reduced . 
In the embodiment described above, because a chest radiation image 
has been the subject of processing, and in both the image that 
has been subjected to warping (the first image,) and the base 
image (the second image,) the area of interest is the chest, it 
is preferable that said two images be subjected to chest 
recognition processing, in which all the pixels of portions of 
the image other than that representing the chest are assigned 



a fixed pixel value. Note that the techniques and technology 
disclosed in Japanese Unexamined Patent Publication No. 
8 (1996) - 335271 may be applied as such chest recognition 
processing . 
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